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A short survey on nonlinear models of the classic Costas loop: 
rigorous derivation and limitations of the classic analysis. 

Best R.E.^ Kuznetsov Kuznetsova O.A.^, Leonov G.A.^, Yuldashev M.V.^, Yuldashev R.V.^ 


Abstract — Rigorous nonlinear analysis of the physical model 
of Costas loop — a classic phase-locked loop (PLL) based circuit 
for carrier recovery, is a challenging task. Thus for its analysis, 
simplified mathematical models and numerical simulation are 
widely used. In this work a short survey on nonlinear models 
of the BPSK Costas loop, used for pre-design and post-design 
analysis, is presented. Their rigorous derivation and limitations 
of classic analysis are discussed. It is shown that the use of 
simplified mathematical models, and the application of non 
rigorous methods of analysis (e.g., simulation and linearization) 
may lead to wrong conclusions concerning the performance of 
the Costas loop physical model. 

I. INTRODUCTION 

The Costas loop is a classic phase-locked loop (PLL) 
based circuit for carrier recovery [1], [2]. In this paper the 
classic analog Costas loop [1], [3], used for Binary Phase 
Shift Keying signals (BPSK) is considered. Costas loop 
is essentially a nonlinear control system and its physical 
model is described by a nonlinear non-autonomous system 
of discontinuous differential equations {mathematical model 
in the signal space), whose rigorous analytical is a difficult 
task. Thus, in practice, numerical simulation, simplihed 
mathematical models, and linear analysis are widely used 
for the analysis of PLL based circuits (see, e.g., [3]-[8]). 

In the following it is shown that 1) the use of simplified 
mathematical models, and 2) the application of non rigorous 
methods of analysis (e.g., a simulation) may lead to wrong 
conclusions about the performance of the Costas loop phys¬ 
ical model. 

To demonstrate this, the operation of the Costas loop will 
be considered in details. 

IT Classical engineering consideration of the 
Costas loop operation 

The operation of the Costas loop is considered first in the 
locked state (see Fig. [T]), hence the frequency of the carrier is 
identical with the frequency of the VCO (Voltage-Controlled 
Oscillator); further it is assumed that both of these signals 
are sinusoidal. 

The input signal is a BPSK signal, which is the product 
of a transferred binary data (m(f) G {±1} for any t) and 
the harmonic carrier sin(cof) with a high frequency (0. Since 
the Costas loop is considered to be locked, the VCO output 
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Pig. 1. Costas loop is locked (the case of equal phases of input carrier 
and free running VCO output): there is no phase difference. 

signal is synchronized with the carrier (i.e. there is no phase 
difference between these two signals). The input signal is 
multiplied (multiplier block (0)) by the VCO signal on the 
upper branch and by the VCO signal, shifted by 90°, on the 
lower branch. Therefore on the multipliers’ outputs one has 
(pi(f) = \{in{t) —m(f)cos(2cof)),(p2(f) = j (m(f) sin(2(af)). 

Consider the low-pass biters (LPFl and LPF2) operation. 

Assumption 1: Signals components, whose frequency is 
about twice the carrier frequency, do not affect the synchro¬ 
nization of the loop (since they are completely suppressed 
by the low-pass biters). 

Assumption 2: Initial states of the low-pass biters do not 
affect the synchronization of the loop (since for the properly 
designed biters, the impact of biter’s initial state on its output 
decays exponentially with time). 

Assumption 3: The data signal m{t) does not affect the 
synchronization of the loop. 

Assumptions 1 1|2| and [^together lead to the concept of so- 
called ideal low-pass filter, which completely eliminates all 
frequencies above the cutoff frequency (Assumptionfl]) while 
passing those below unchanged (Assumptions |2|3| h In the 
classic engineering theory of the Costas loop it is assumed 
that the low-pass biters LPFl and LPF2 are ideal low-pass 
biters. 

Since in Fig. the loop is in lock, i.e. the transient 
process is over and the synchronization is achieved, by 
Assumptions |1|2| and for the outputs gi.iit) of the low- 
pass biters LPFl and LPF2 one has gi (f) = g 2 (t) — 0. 

Thus, the upper branch works as a demodulator and the lower 
branch works as a phase-locked loop. 

Since after a transient process there is no phase difference, 
a control signal at the input of VCO, which is used for VCO 
frequency adjustment to the frequency of input carrier signal, 
has to be zero: g{t) = 0. In the general case when the carrier 
frequency (O and a free-running frequency (Ofree of the VCO 
are different, after a transient processes the control signal at 
the input of VCO has to be non-zero constant: g{t) = const, 
and a constant phase difference 0 a may remain. 

















Consider the Costas loop before synchronization (see 
Fig. |2|. Here the phase difference 0 a( f) =0i(f) —02(f) 
varies over time, because the loop has not yet acquired lock 
(frequencies or phases of the carrier and VCO are different). 






sin(0/t)) 




[Loop filter 


<p(t)=|sm(20j(t)). 




Fig. 2. Costas loop is out of lock: there is time-varying phase difference. 


Caveat to Assumption The low-pass filters can not 
operate perfectly at the moments of changing m{t), therefore 
the data pulse shapes are no longer ideal rectangular pulses 
after filtration. One known related effect is called false- 
locking: while for m{t) = const the loop acquires lock and 
proper synchronization of the carrier and VCO frequencies, 
for time-varying m{t) ^ const the loop may seem to acquire 
lock without proper synchronization of the frequencies (false 
lock) [15], [16]. To avoid such undesirable situation one 
may try to choose loop parameters in such a way that the 
synchronization time is less than the time between changes 
in the data signal m{t) or to modify the loop (see, e.g., [15]). 


In this case, using Assumption the signals (pi,2(0 can 
be approximated as 

(pi(f) « ^m(f)cos(0A(f)), (P2(f) « ^m(f)sin(0A(f)). (1) 

Approximations 0 depend on the phase difference of 
signals, i.e. two multiplier blocks (0) on the upper and 
lower branches operate as phase detectors. The obtained 
expressions 0 with m{t) = 1 coincide with well-known (see, 
e.g., [3], [9]) phase detector characteristic of the classic PLL 
with multiplier/mixer phase-detector for sinusoidal signals. 

By Assumptions and the low-pass filters outputs can 
be approximated as 

gi(f) « im(f)cos(0A(f)), g2{t) ~ ^m(f)sin(0A(f)). (2) 
For m^{t) = 1, the input of the loop filter is 

9(0 =^i(0^2(0 «9(9A(f)) = ^sin(20A(f)). (3) 

Such an approximation is called phase detector characteris¬ 
tic of the Costas loop. 

Since an ideal low-pass filter is hardly realized, its use in 
the mathematical analysis requires additional justification. 

Thus, the impact of the low-pass filters on the lock 
acquisition process must be studied rigorously. Also, the 
following caveats should be acknowledged. 

Caveat to Assumption While Assumption is reason¬ 
able from a practical point of view, its use in the analysis 
of Costas loop requires further consideration (see, e.g., [10], 
[11]). Various averaging methods (see, e.g., [12]) allow one 
to justify Assumption and obtain conditions under which 
it can be used rigorously (see [13], [14]). 

Caveat to Assumption Since in Fig. the loop is 
out of lock, i.e. synchronization is not achieved, low-pass 
filters’ initial states cannot be ignored and must be taken 
into account. Therefore for rigorous consideration of low- 
pass filters influence one has to use a rigorous mathematical 
model of the low-pass filters instead of approximations 
0. Since low-pass filter LPF2 is mostly used to indicate 
synchronization status and low-pass filter LPFl is mostly 
used for data demodulation, the effect of nonzero initial state 
of filter on transient processes will be discussed below for 
the loop filter, which is used to provide synchronization. 


The relation between the input (p(f) and the output g{t) of 
the loop filter has the form 

x = Ax-\-b(f{t), g{t) =c*x-\-h(f{t), (4) 

where A is a constant matrix, the vector x(t) is the loop 
filter state, b,c are constant vectors, h is a number. The 
control signal g{t) is used to adjust the VCO frequency to 
the frequency of the input carrier signal 

02(f) = (02(f) = + (5) 

Here is the free-running frequency of the VCO and L 
is the VCO gain. The solution of 0 with initial data a:( 0) 
(the loop filter output for the initial state a:( 0)) is as follows 

g(f,A:(0)) = ao(f,x(0))-f/Y(f-x)9('i:)dT-|-/!(p(f), (6) 

0 

where Y(f — x) = c*e^^'^'^'^b-\-h is the impulse response of 
the loop filter and ao(f,v(0)) =c*e^‘x{Q) is the zero input 
response of the loop filter, i.e. when the input of the loop 
filter is zero. 

Assumption 4 (analog of Assumption^: Zero input of 
loop filter ao(f,A:(0)) does not affect the synchronization 
of the loop (one of the reasons is that ao(f,x(0)) is an 
exponentially damped function for a stable matrix A). 
Consider a constant frequency of the input carrier: 

0i(f) = (Oi(f) = coi, (7) 

and introduce notation: (O^®® = (0i — ( 02 ^*“^. Then Assump¬ 
tion |4] allows one to obtain the classic mathematical model 
of PLL-based circuit in signal’s phase space (see the classic 
Viterbi’s book [9]): 

0a = co*®®-L / Y(f-'i:)(p(0A(T:))dx-L/!(p(0A(f)). (8) 

Jo 

Since (P(0a) from 0 is an odd function and has period 7t, one 

has (cof®®,0A(f)) (- ®i“,-9A(0) 0A(f) 0 a(0+ 

Kk do not change 0. Therefore in 0 one can consider 
only nonnegative (O^® (|(0^®®| called frequency deviation) 
and 0a(O) € [~^/2,7t/2). The classic engineering task is to 
find the following sets: the hold-in range includes such |co|®®| 
that 0 has a stationary state 0 a (f) = 0 a^ which is locally 
stable (local stability, i.e. for some 0a (0)); the pull-in range 
includes such |co^®®| that any solution of 0 is attracted to 

















one of the stationary state 0^'^ (global stability, i.e. for all 

eA(o)). 

Caveat to Assumption While Assumption allows 
one to introduce one dimensional stability ranges, defined 
only by |co^“|, ao{t,x{Q)) may affect the synchronization 
of the loop and stability ranges. For rigorous study one has 
to consider multi-dimensional stability domains, taking into 
account (a)^“,A:( 0 ),A:i( 0 ),A 2 ( 0 )), and explain their relations 
with the classic engineering ranges [17] (e.g., it is of utmost 
importance for cycle slips study [18], [19] and lock-in range 
definition). 

Note that while Assumptionj^is explained at the beginning 
Viterbi’s classical book [9] for the stable matrices A only, 
further in the book, various filters with marginally stable 
matrices are also studied (e.g. filter - perfect integrator where 
A =0). 

It is also interesting that for model © with h — Q (see, e.g., 
eq. (2.18) in [9]) the initial difference between frequencies 
I9 a(0)1 = |®a(0)| is equal to the frequency deviation |co*“|. 
So these terms are often used in place of each other, which is 
not correct for a( 0) ^ 0, 0 or a non odd function (p(0a)- 

While the classic model (|^ may be useful at the stage of 
post-design analysis (when the input and the VCO output 
are considered only and the parameters are known only 
approximately), for the pre-design analysis (when all the 
parameters of the loop can be chosen precisely) one may use 
more informative models considered in the next sections. 

III. Nonlinear models oe Costas loop 

The relation between the inputs tp 1 , 2(0 the outputs 
gi, 2 {t) of linear low-pass filters is as follows 

•* 1,2 =Ai.2Xi,2+^1,291.2(0: ^ 1 , 2(0 =‘2i,2-T1,2- (9) 

Here Ai 2 are constant stable (all eigenvalues have negative 
real part) matrices, the vectors xi, 2 (f) are low-pass filters’ 
states, bi ,2 and ci ,2 are constant vectors, the vectors xi, 2 ( 0 ) 
are initial states of the low-pass filters. For the loop filter 
one can consider more the general equation 0 with a 
proportional term. 

Taking into account (|^, (0, and (|^, one obtains the 
mathematical model in the signal space, describing the 
physical model of BPSK Costas loop,: 

x\ =Aixi +fiim(f)sin( 0 i(f))sin( 02 ), 

X 2 = A 2 X 2 + b 2 m{t) sin(0i (f)) cos( 02 ), 

X =Ax + b{c*iXi){c2X2), ^ 

02 = 032 '^'^'^ + L{c* x) ~\- Lh{c\xi){c 2 X 2 ) ■ 

Note that Assumptions 1-4 are not used in the derivation of 
system 

The mathematical model in the signal space is a 
nonlinear nonautonomous discontinuous differential system, 
so in general case its analytical study is a difficult task even 
for the continuous case when m{t) = const. Besides it is a 
slow-fast system, so its numerical study (corresponding to 
the SPICE level simulation) is rather complicated for the 


high-frequency signals. The problem is that it is necessary 
to consider simultaneously both very fast time scale of the 
signals sin( 0 i, 2 (f)) and slow time scale of phase difference 
0 A(t), therefore a very small simulation time-step must be 
taken over a very long total simulation period [ 20 ]. 

To overcome these problems, in place of using Assump¬ 
tion 2 one can apply averaging methods [12], [14] and 
consider a simplified mathematical model in signal’s phase 
space. However, this requires the consideration of a constant 
data signal (Assumption and constant frequency of input 
carrier 0 , i.e. 

OT(f) = l, 0i(f) = cop+ 0i(O). 

In this case is equivalent to 

x\ =Aixi +fiisin((aif+ 0i(O))sin((aif+ 0 i(O) + 0a), 

21:2 = A 2 a :2 + ^2 sin(® 1 f + 01 ( 0 )) cos (® 1 f + 01 ( 0 ) + 0 a) , 

X = Ax + b{ciXi){c 2 X 2 ), 

0 ^ = -L{c*x) -Lh{c’lxi){c* 2 X 2 ). 

( 11 ) 

Here the initial (at f = 0) difference of the frequencies has 
the form 

0a(O) = coa(O) = -Lc*x{0) -Lhclxi{ 0 )c* 2 X 2 { 0 ). (12) 

Assuming that the input carrier is a high-frequency signal 
(i.e. ©1 > is sufficiently large), one can consider small 
parameter e = Denote T = ©+. Then system o can be 
represented in the following way 

^=eF(z,T), z= (ai,A2,2c,0a)*. (13) 

ax 

Consider the averaged equation ( [T3| > 

dy - - 1 

= ^F{y). F{y) = ^ /q F{y,T.)dT:. (14) 

Suppose, D is a bounded domain, containing the point 
zo = (a:i(0), 21 : 2 ( 0 ), 2 c(O), 0 a(O)). Consider solutions z(T,e) and 
y(T,e) with the initial data zo =yo- In this case there exists a 
constant T such that z(x,e) and y(T, 8 ) remain in the domain 
D for 0 < X < |. Define 

Theorem 1: [12] Suppose that Emax, D, and T are as 

above. Then there exists a constant c > 0 such that | |y(f,e) — 
z(f, e) 11 < ce for 0 < e < Emax and 0 < f < j. 

Remark. Time T has to be defined by the time of the 
transient processes. The theorem does not suggest how to 
define T by the loop parameters, so T is supposed to be 
estimated experimentally. Also note that the averaged system 
can be considered only if 

0 < < ©l,©2(f): 

|(0i-®2(f)l<<“ VfG[0,r], 

where does not depend on and is sufficiently 
large. 


. 1 



Fig. 3. Mathematical model of BPSK Costas loop in signal’s phase space 


In this case the averaged system ([T4| gives a mathematical 
model of BPSK Costas loop in signal’s phase space (see 
Fig.0: 

XI =Ai;ci + y cos(0a), ;c2=A2X2 + y sin(0A), 

X = Ax-\-b{c\x\){c2X2), 

9 a = ®A®*^ — Lie* x) — Lh{c\xi){c 2 X 2 ) ■ 

Here, under condition ( [T5| l, Theorem[T]provides the closeness 
solutions of averaged ( [T6] l and original ( [T0| l systems. Remark 
that in ( [Thl l the initial difference between frequencies ®a(0) 
coincides with ( [T^ . 

Mathematical model (HI does not coincide with that, 
considered in the classic works [2], [9]. The classical math¬ 
ematical model of the Costas loop can be obtained from this 
model under additional assumptions. 


A. Classical model of BPSK Costas loop 

Having solved the first two equations of system ( [T6| ), one 
obtains 

C 1 

c^xi =ai(f,xi(0))-f / Yi(f-T)-cos(0A(i:))t/i:, 

Jo 2 

r’ 1 

C 2 X 2 = a2(f,X2(0))+ / Y2(f-T:):::sin(0A(T))£/T. 

Jo 2 

Here the impact of filter’s initial state on its output decays 
exponentially with time (see Assumption ^ and one can 
consider t > to, such that ai, 2 (f,xi, 2 ( 0 )) = 

Since the low-pass filters LPFl and LPF2 are assumed to 
be ideal (see Assumptions [T]|^, under conditions CD their 
operation can be formalized as 

[ Yi,2(f-T:)sin(0A(T))t/i: = sin(0A(f)) +e)(^). 

JtQ U) 

Then for t > to one has 
1 


ClXl{t) = - cos (0A(f)) 
C* 2 X 2 {t)^ ^sin(0A(f))- 


hO( 

- 0 { 


CO" 


(17) 


CO" 


Applying ( [T7] i to ( fTh] ), for t > to one obtains 
x=Ax + b^sm{2QA) + 0{-J^), 


0A = 


— Lc*x — Lh - sin(20A) — 0 {—^ 


(18) 


)• 


Assumption 5 (Corollary of Assumptions 1-3)): 

Solutions of system ( [Thl l are close to solutions of the 
following system 

X = Ax b((i{QA), 


dA = - Lc*x - L/!(p(0a), 


( 19 ) 


i.e. in system ( [T6] l can be neglected. 



Fig. 4. Classical (simplified) mathematical model of BPSK Costas loop 
in signal’s phase space 


System corresponds to the block-diagram shown in 
Fig. 0 where (P(9 a) is the phase detector characteristic of the 
Costas loop for sinusoidal signals. Note that here the phase 
detector operation includes the operations of three multipli¬ 
ers, phase shift element 90°, LPFl, and LPF2. System ( [T9] ) 
with h = Q and x(0) = 0 corresponds to system il- 

Caveat to Assumption For rigorous justification of 
Assumption one may analyze stability conditions for 
system ( [T9] l (see, e.g., criteria of stability in the large for 
the pendulum-like systems [17]). 

In some applications a modification of the BPSK Costas 
loop, shown in Fig. is used. Here low-pass filters LPFl 
and LPF2 do not affect the operation of the modified BPSK 
Costas loop (i.e. Assumption is not needed); the input of 
the loop filter does not depend on the data signal m{t) (i.e. 
Assumption]^ is not needed); 

(p(f) = (pi (f )(p 2 (f) = sin(ei (f)) sin( 02 (f)) sin(0i (f)) cos( 02 (f)). 



Fig. 5. A modification of BPSK Costas loop 


Taking into account (0 and (]^, one obtains a mathemati¬ 
cal model in the signal space describing the physical model 
of modified BPSK Costas loop; 

x=Ax-\-b((){t), 0A = (0**^*^ —Lc*x —L/i(p(f). (20) 


The averaged system ( ]20] l gives a mathematical model of 
modified BPSK Costas loop in signal’s phase space (see 
Fig. ]§ which corresponds to ( [T9] ). Here, under condition 
, from Theorem [T] it follows that the solutions of systems 
and are close. The approach suggested in [13], 
[14 , [21], [22] allows one to find an approximation (P(0 a) 
in the case of non-constant frequency of the carrier or non 
sinusoidal signals. 


11 

(]20 


IV. Summary of the models 

• physical model (with data signal and low-pass filters) 
or its mathematical model in the signal space (Fig. [^ or 
Fig-0 and system ([TO])); 






















































Fig. 6. Block-diagram of Costas loop mathematical model in the signal 
space described by transfer functions and initial conditions 


• simplified mathematical model in the signal space (with¬ 
out data signal and with low-pass filters)) (system 
and Fig. |^or Fig. with m{t) = 1); 

• modified physical model (with data signal and with 
external low-pass hlters) or its mathematical model in 
the signal space (Fig. and system (|20|)); 

• simplified mathematical model in signal’s phase space 
(without data signal and with low-pass hlters) (system 
( fT 6 | ) and Fig. [^; 

• classic mathematical model in signal’s phase space 
(without data signal and without low-pass hlters) (sys¬ 
tem ([Tg and Fig. 1^. 

V. Costas loop simulation and counterexamples 
TO THE Assumptions 

Note once more that various simplihcations and analysis of 
linearized models of control systems may result in incorrect 
conclusions. At the same time the attempts to justify ana¬ 
lytically the reliability of conclusions, based on engineering 
approaches, and rigorous study of nonlinear models are quite 
rare (see, e.g., tutorial [23]). 

Further it is demonstrated that the use of the above 
engineering Assumptions requires further study and rigorous 
justihcation. Next examples shows that for the same parame¬ 
ters the behaviors of considered models may be substantially 
different from one another. 

A. Simulation examples 

Next the following parameters are used in simulation; 
low-pass hlters transfer functions Hipf{s) = , 0)3 = 

1.2566* 10® and corresponding parameters in system 0 
are Ai ,2 = —CO 3 , bi 2 = 1 , ci .2 = ® 3 ; loop hlter transfer 
function Hif{s) = T 2 = 3.9789 * 10^®, Xi = 2 * 10^®, 
and corresponding parameters in system Q are A = 0, h = 1, 
c = :^, h = ^; carrier frequency coi = 2*71*400000; VCO 
input gain L = 4.8* 10®; and carrier initial phase 62 ( 0 ) = 

ei(o) = o. 

Example 1 (double frequency and averaging): InFig.|7]it 
is shown that Assumption may not be valid if conditions 
for the application of Theorem are violated; mathematical 
model signal’s phase space (see Fig. system @) (black 
color) and physical model (see Fig. system ([Tgi) (red 
color) after transient processes have different phases in the 
locked states. 




Eig. 7. Low-pass filter outputs g[ (t) and phase difference 0 a (f) for averaged 
model {T^ (black) and physical model (red) in Eig.j^ 



Fig. 8. Loop filter output g(?) for physical model (black) with zero initial 
states of low-pass filters, physical model (red) with nonzero initial states of 
low-pass filters. 


Here VCO free-running frequency =2*71*400000 — 

600000; initial states of hlters are all zero; x( 0 ) = xi ( 0 ) = 
X 2 O = 0 (i.e. ao(f,T( 0 )) = ap 2 (CTi, 2 ( 0 )) = 0 ). 

Example 2 (initial states of the low-pass filters): 

In Fig. 1^ it is shown that Assumption may not be 
valid; while physical model (see Fig. system ®) with 
zero initial states of low-pass hlters acquires lock (black), 
the same physical model with nonzero initial states of 
low-pass hlters is out of lock (red). 

Here VCO free-running frequency =2*71*400000 — 

2, initial state of the loop hlter is zero; .r(O) = 0 (i.e. 
ao{t,x{Q)) = 0), Initial states of the low-pass hlters are 
xi ( 0 ) = X 2 { 0 ) = 0 (black) and xi ( 0 ) = 0 . 02 , X 2 ( 0 ) = 0 (red). 

Example 3 (data signal): In Fig. it is shown that As¬ 
sumption 1 ^ may not be valid; while the simplihed mathe¬ 
matical model in the signal space (see Fig. |^with m(f) = 1, 
system GD) acquires lock (black), physical model with (see 
Fig. 0 system ( [T0| )) with periodic data is out of lock (red). 

Here VCO free-running frequency = 3.2* 10®, initial 
states of hlters are all zero; x( 0 ) = ai( 0 ) = X 2 { 0 ) = 0 , data 
signal is periodic; m{t) = signsin(10® * 2 * 7 t*f). 




Fig. 9. Loop filter output g(r) for physical model (red) with periodic data 
signal, physical model (black) with constant data signal m{t) = 1. 











































Fig. 10. Loop filter output g{t) and phase difference 0a(?) for signal’s phase 
space model (black) with low-pass filters, classic signal’s phase space model 
(red) without low-pass filters, and signal space model (green). 


Fig. 12. Filter outputs: default integration parameters in Simulink ’max 
step size’ set to ’auto’ (black curve); Parameters configured manually ’max 
step size’ set to ’le-3’ (red curve). 



Fig. 11. Loop filter output g(r) and phase difference 0 a(?) for physical 
model with zero initial state of loop filter (black), physical model with 
nonzero initial state of loop filter (red). 



Fig. 13. Phase portrait: coexistence of stable and unstable periodic 
solutions. 


Example 4 (low-pass filters): In Fig. it is shown that 
the consideration of the ideal low-pass filters (Assump¬ 
tions [T]^ and[^ may lead to wrong conclusions: it is shown 
that low-pass filters may affect the stability of models in 
signal’s phase space. While simplified mathematical model 
in signal’s phase space (see Fig. system @) (black) 
and simplified mathematical model in the signal space (see 
Fig. with m{t) = 1, system ( [TT] )) (green) are out of lock, 
the classic mathematical model in signal’s phase space (see 
Fig. El system (EH), where low-pass filters are not taken into 
account, acquires lock (red). 

Here VCO free-running frequency =2*71*400000 — 
500000, initial states of filters are zero: .x(O) = xi (0) = 
■* 2 ( 0 ) = 0, no data is being transmitted: m(t) = 1. 

Example 5 (initial state of the loop filter): In Fig. 11 it 
is shown that Assumption 


physical model (see Fig. |6 


^ may not be valid: while the 
system ( [T0| ) with zero output 
of loop filter acquires lock (black), the same physical model 
with nonzero output of loop filter is out of lock (red). 

Here initial states of low-pass filters are zero: 21:1 (0) = 
•* 2 ( 0 ) = 0; VCO free-running frequency = 2 * 7t * 

400000— 10; initial loop filter state is 2c(0) = —0.00001 (red) 
and 2 i:( 0 ) = 0 (black). 

Example 6 (numerical integration parameters): 

In Fig. 12 it is shown that standard simulation of the loop 
may not be valid: while the classic mathematical model in 
signal’s phase space (Fig. or system ([T^), simulated in 
Simulink with predefined integration parameters: ’max step 
size’ set to ’le-3’, is out of lock (black), the same model 
simulated in Simulink with default integration parameters: 
’max step size’ set to ’auto’, acquires lock (red). Here 
Matlab chooses step from 5 • 10^^ to 9 • 10^^; for fixed step 


2-10^^ the model acquires lock, for fixed step 1 • 10^^ the 
model doesn’t acquire lock. 

Here the initial loop filter state output is 2i:(0) = 0.0125; 
VCO free-running frequency = 10000 — 89.45; VCO 
input gain L = 1000; initial phase shift 0a(O) = —3.4035. 

Consider now the corresponding phase portrait (see 
Fig.[T3]l. Here the red trajectory tends to a stable equilibrium 
(red dot). Lower and higher black trajectories are stable 
and unstable limit cycles. The blue trajectory tends to a 
stable periodic trajectory (lower black periodic curve) and 
in this case the model does not acquire lock. All trajectories 
between black trajectories (see green trajectory) tend to the 
stable lower black trajectory. 

If the gap between stable and unstable trajectories (black 
lines) is smaller than the discretization step, the numerical 
procedure may slip through the stable trajectory (blue trajec¬ 
tory may step over the black and green lines and begins to 
be attracted to the red dot). In other words, the simulation 
may show that the Costas loop acquires lock although in 
reality it does not. The considered case corresponds to the 
coexisting attractors (one of which is a hidden oscillation) 
and the bifurcation of birth of a semistable trajectory [24]. 

Note, that only trajectories (red) above the unstable limit 
cycle is attracted to the equilibrium. Hence cOa = 89.45 does 
not belong to the pull-in range. 

VI. Conclusion 

In this paper a short survey on derivation of nonlinear 
mathematical models of BPSK Costas loop, used for pre¬ 
design and post-design analysis, is presented. It has been 
shown that 1) the consideration of simplified mathemati- 



















cal models, constructed intuitively, and 2) the application 
of non rigorous methods of analysis (e.g., simulation and 
linearization) can lead to wrong conclusions concerning the 
operability of the Costas loop physical model. Similar result 
can be obtained for the classic PLL and QPSK Costas loop 
(see, e.g., [11], [25], [26]). 

While the Costas loop is a nonlinear control system and for 
its analysis it is essential to apply various stability criteria 
developed in the control theory, their direct application to 
the PLL-based models is impossible, because such criteria 
usually are not adapted for the cylindrical phase space. In 
the tutorial Phase Locked Loops: a Control Centric Tuto¬ 
rial, presented at the American Control Conference 2002, 
D. Abramovitch wrote that “The general theory ofPLLs and 
ideas on how to make them even more useful seems to cross 
into the controls literature only rarely” [23]. 

Corresponding modifications of the classic stability criteria 
for the rigorous analytical analysis of nonlinear PLL-based 
model in the cylindrical phase space had been well developed 
in 197x-199x in [27]-[29]. See also some recent works on 
nonlinear methods for the analysis of PLL-based models 
[17], [30]-[36]. One of the reason why these works have 
been remained almost unnoticed by the engineers may be 
that they are mostly written in the language of the control 
theory and the theory of dynamical systems, and, thus, may 
not be well adapted to the terms and objects used in the 
engineering practice of phase-locked loops. Another possible 
reason is that “nonlinear analysis techniques are well beyond 
the scope of most undergraduate courses in communication 
theory” [7]. 

The examples, considered in the paper, are the motivation 
to apply rigorous analytical methods for the analysis of PLL- 
based loop nonlinear models. 
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